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The puftpose of this article is to suggest the value 
of a research tool which has rarely been used in studies in 
insttuction in writings baseline measurement of group and individual 
performances* This approach was usgd in examining the results or a 
study of a self-instructional program in narrative -writing which *w as 
prepared for and tested by secondary school students. During 
instruction^ a process approach 'to writing^ students were taught, to . 
use a set of questions to systematicaily and sequentially select a 
subject for a naurrativer to develop a rough drafts and to make 
additions to expand the narrative. The goal of instruction was that ' 
students would achieve and/or maintain control of the strticture of 
the narrative while learning to expand their narrative for the sake 
of completeness^ development, : and interest. An instrument was 
designed to measure three qualities indicative of control of 
structure and three characteristics of expansion. Of the 27 students 
who completed the program, the majority showed positive 
pretest-posttest changes in the ^ variables related to expansion and 
demonstrated control of structure on both pretests and posttests. The 
baseline measures were found to be very useful. (JM) 
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Discussipns in bothrpopular and professional periodicals reveal 

a near urfiversal criticism of in$truction in writing. The gpeat 

- quantity and variety of research in instruction in writing has 

apparently had little effect in itnproving instruction* Experimental 

studies generally have, been plagued with some 'shortcomings; In inany 

c^ses, objective, systematic measurements have ^b^ 

"negative behaviors" (ones that most teachers agree are the least 

important aspects of writing) errors,, in spelling, punctuation, 

and usage • Attempts to measure positive -behaviors, with only a few 

recent exceptions , have been limited to quick,* overall, subjective 

^ ratings of hard-to-define (and often undefined) qualities: signifi- 

cance, interest, clarity, sincerity, uriity. 

, Experimental studies have tended to focus on the group arid to 

neglect the individual* Typically a method is examine^ by comparing 

it to one or more other methods, with effe^iveness (or its lack) 

reported solely in terms of mean performance. tT3rpi<^lly, no attempt 

^ is made (or at least the attempt is not reported) to demonstrate and 

<i\ increase the effectiveness of a method before comparing it to others. 

A related problem has been that pre and post measures have not 

0 fe^en used (and are still not ^used widely). Without them, the 



reseaigjher has no way of demonstrating that any changes occurred 



during or after tt»eati»ent,^ t^ qualities demonstrated were not present 
prior to instriiction, or that , sufficient" nunibers of students demon- 
sttBted enough positive gains to justify comparing the raethc^s with 
others* 

A roost difficult problem has been specifying positive behaviors as 
objectives for instruction and finding objective, valid, and reliable 
ways of measuring those changes^ And this problem, in turn, may be* 
part of the most pressing problem of all: a lack of definition and ^ 
agreement of the goals of instruction in writing. - , 

At the risk of oversimplification, the problem may be suimfted up 
as follows: Is the goal of any instruction, whether it be at the^ 
elementary, secondary or college level, to identijEy those students 
who can already meet adult, professional standards, so that those 
students may^ be selected for tracking, placement,, or qualification 
for special courses? Or, is tie goal of any instruction to provide 
students with the opportunity to work towarrf^ those standards by 
increasing ^and strengthening, over a period of time, desirable 
behaviors? 

This writer subscribes to the second goal, and that goal is the 
WQjtivation for this article. The main purpose of the article is to 
suggest the possible value of a^research "tool'' that can be xised in 
addition to procedures commonly employed in research in writing: 
baseline tLasurement of group and individual performances* The^more 
iwi».diat« piippoae of this article is to report on the use of that "tool 
in analyzing the results of a itudy of one instrtictional method. 



••Baseline meaauremar^'^ is defined as follows: the researcher 
observes and 3?ecord8 the students* (or subjects behavior prior to 
instruction. The researcher then continues to observe the behavior 
thrdughout the period of the instruction and, when analyzing and 
interpreting hiai data, uses all observations of the behavj.or rather 
than juatt observations before and after instruction (or pre-post * 
changes)* Baseline tneasurement, thus, can yield more data about both 

groups and indiyi duals and the effects of instruction^^ 

• ^ ... * 

A self-instructional program in narrative writing was written for 
and tested by secondary schoool students • The program was not compared 
with other materials or methods • Rather, the purposes of the testing 
w^pe; (1) to incxHsase the effectiveness bf the instruction by t^ing 
it out aid revising it in light bf responses mad^ by students, an4 
(2) to examine the Npbssibility of using objective measures of positive 

- 1 . . ,n. -, ■ ^- :\ \ 

changes in particular writing behaviors » The instrijption taught 'a 
process-approach to writing. Students ^jjiire taught to use a set of 
questions to systematically andf sequent iall3^ select a subject for a 
narrative, develop a rough draft, and make additions to expand the 
narrative. i? '^'^ 

^ The goal of the instruction was that students would achieve and/or 
maintain control of the structure of the narrative while * learning to 
expand their narratives for the sake of completeness, development, 
and interest. An instrument was designed to measure, objectively, 
three qualities indicative of control of structure (unity, point of 
view, and chronological order) and three characteristics of expansion 
(completeness, in terms of number of basic questions answered in the 



" .'" . " - ' " ^ ■ .. ■ ■ 
narrative; ^developiiient, in tarw3 of nunber of words that answered each 
of the questions; and total niunber of words or length of the narratives). 

The instruction was tried out^y individual students and revised 
and then tried out by'a^group of stuclents. The effectiveness of the 
program was demonstrated to this extent, Laraberg, (197*f): of the 37 
students who .'started the program, 27 coiupleted it. Of the 27 who 
completed it, the majority showed positive pre-post changes in the three 
variables related to expansiw, and the mean pre-post changes were 
statisti/cally significant. The majority demonstrated control d€ 
structure on both pre and posfp-tests, • * 

On the negative side, an examination of the responses to the program 
revealed that the students who did not complete the program ^had the 
same 3?ange o'f pre-test perforrnwices as those that did complete it, 
that some stxidents showed steady decreases from the pre-test p^e.rf ormance , 
that many^tudents showed erratic changes from one narrative to. * 
another, and that there were manysinstances of inappropriate responses 
to frames in the last two section/ of the program. . 

It was hoped that an analysis of baseline measures of the group • 
and the individual studentrf performances would' aid in verifying the ^ 
apparent weaknesses of the instruction and in suggesting a course of 
action for iir5>roving the instruction and for further research. The 
analysis was limited to one variable, that of number of words in each 
nar»rative» A poeitive correlation had beei^ discovered between total 
n\xmber of words and the other two variables measxired to determine 
improvement in expansion, Lamberg (197^). 
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the i>er£c«»inances of 19 students were exandned* These students txirned 
in all of the narratives they wrote. The other students turned in only 
their pre and post -narratives* . Table 1 repcxrts the performances (as 
measured in nuniber of words) on four narratives or trials. The first 
trial was used m a pre-test; the fourth was used as a post-tetst* The 
mean score on the first trial was 162.7; on the second, 213«9; on the 
third, 170;7; and, on the fourth, 217.0. 

Table 1 about here 

_____ — - ■ ■ 

Performances on the second, third, and fourth trials were cdinpared 
to performances on the first to determine changes in performance ♦ 
Those changes, in terms of increases or decreases- in number, of words, 
and percentage increases and decreases, are reported in Table 2. The 
mean gain in nunter of words on the second trial was 61i8 or 45 percent; 
on the third trial, -21 .3 or 18 perctet; and on the fourth trial, '5{^.5 
or 37 percent. 

Table 2 about here , 

A count was made of the number of students who showed increases, 
decreases, or no changes from the first trial through the subsequent 
ttials. On the second trial, of the 19 students, 15 showed increases, 
If showed decreases; on the third, m showed increases, 5 showed 
decreases; on the fourth, 16 showed increases; 3 showed dei|peases. 

To analyze the effect of the instruction on individual students, 
a comparison was made of the performances by each student on each 
subsequent trial with the performance on the first trial. Of the 
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19 »t\Klent«, 12 showed inca^aaaes all three of the trials; 2 showed 
decreases on all three; and 5 showed both Increases emd decreases. 

A-iPurther comparison was made, for those students'- who showed 
pre-post gains, between subsequent nairativea' and' thi* perforroance 
on the first trial to detennin<i: (1) how wapy students made steady 

«i 

gains; (2) how many showed unsteady gains; and (3) how many showed 
erratic changes, that is, the performance on the second or third 
trial shdreda decrease from that of the first trial. Of the 19 
students, 16 showed pre-post gains ^ Of those 16^ only one showed 
steady gains frow one trial to the next, a if 4- to ^1 to 51 percent ^ 
increase on the second, third, and fourth trials from the first trial. 
Eleven showed Tinsteady gains. Four showeS erratic changes, both 
increased anji decreases from the performaince on the first trial. 
^ *A co!i5>arison of the performance of each student on his third 
trial ^with that on his second revealed that 6 showed an increase fpom 
the second tria(l;* 13 showed a .decrease. A comparison of the performance 
on the fourth trial witft that on the second showed that 9 showed an 
increase from the second trial; 10 showed a decx»*ase. A cowqpariSon of 
the performance on the fourth trial with that of the third revealed 
that io showed an' increase; 9 showed a decrease. 

lB5)lications : The Effectiveness of the Instruct^ion 

The instruction consisted of three sections, the first section led 
up to trial '2; the second led up to triil .3» and the thTrd 'Ued up to 
trial the post-test. The data reveals that the second section was 
apparently the least effective. The mean performance was only 7.9if 
points better than that of the firit trial; the mean percentage increase 
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was 18%; of the 19 students, S showed decreases from the first trial. 

\ ■ ' ' ■ ■ « 

The first section of the program would appear to be the most 
effective^ of all the sections in terms of the largest mean increase; 
^5 percent, compared with 18 percent on the third and 37 percent on 
the fourth, However, on the fourth trial more students showed increases 
from the first trial, 16 of the 19 compared with 15 of the 19 on the 
second trial, and the mean performance was 217.0 as compared with 
213,9 on the second trial, , 

The expectation that there would be steady gaips in performances 
becatise of the nature of the instruction (i.e., pTOviding a systematic 
pr<5(:edure for expanding the niu?ratives by answering basic questions) 
was clearly not realized. * Oniy one student showed steady gains. The 
trend in the group performance was a considerable increase on the 
second trial, a considerable drop on the third trial, and a .gain on 
the fourth trial which generally did not meet or surpMS that of the 
' second trial. " ' ' 

Implications: Further Development and Testing of the Instruction 

Why was the performance of students generally erratic? It could 
be that a^ erratic performance is characteristic of sttidents when they 
fia?st experience instruction designed to make direct and considerable 
changes in their writing behaviors. It may be that the very* nature 
of 'the writing experience contributes to erratic behavior; that is, 
there are very important variables beyond the control of researcher 
or teacher. The choice of subject for writing; for example, might 
have a major effect on the quality and quantity of writing and the 
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students* motivation, Or» it: my be that ther^e was a savew weakness 

* in the overall design of the instruction^ In any case, an answer to 

thls>qLuestion must await further development and testing of instruction 

as well as comparison pf treatments with cctotrol groups • 

The information collected^ however, does lend support to the 

author's belief in the desirability 2md possible necessity of looking , 

, at many saunples of writing over a period of time, in order to best 

evaluate both students' achievement and the effectiveness of instruction, 

rather than relying on pre and post narratives. FiJr future research, ^ 

it would be desirable to observe many more occasions of Writing to 

see if positive changes were maintained or increased and if gains* 
• * 

became steadier. 

♦ 

As far as development of the instruction is concerned, it may be 
that less rather than more instruction is desirable. This may be a 
very important consideration. Typically, when self-instrudtional 
materials are developed, they are expanded*. More exercises are ^ 
provided for skills already treated, skills are broken |iown* and the v 
sub-skills are provided for, and instruction* in other related skills 
is introduced. ' , ^ 

In the program -in narrative writing, however, the .basic skills 
in the process-approach were introduced in the first section. The ^ " 
add^ional instruction in other sections may not be necessary. 
Possibly, it may not be desirable; that is^ the work and time required . 
of the students to go through the frames may not have been worth the 
apparently slight benefits, f 

A course of action sxiggested by the comparison of the performances 
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of the seeond'trial with those on the third and fourth is as follows: 
the first section of the progran would be preserved; the other sections 
would be deleted, except for the pr'actice provid6d in the third and 
fourth trials. If the revised program seemed more effective (more 
students showed positive changes, and changes were greater and steadier), 
then it would be worth comparing this treatment to others to control 
for and examine such important variables as'*; the choice of stibject, 
the frequency of practice , the kind of feedback , the content of the 
instruction itself ; that is, the effectiveness of the process-approach. 
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Ta3?le 1 

Ntwber of Words in Narmtives, Written by 
Secondary School Students, Before 
I • During, and After Instruction 



_ \ 

student 


Trail 1 


. Trial 2 


Trial 3 


Trxal 4 


1 


195 


379 


221 . 


260 


2 


361 


232 


233 


154 




107 


231 


166 


129 


236 


» 341 


346 


355 


5 


112 


221 


103 


206 


6 


91 


278 


95 


65" 


7 


134 


128 


54 


234 ' 


6 


143 


60 


"70 


129 


9 


149 


182 


228 


154 


10 


110 


■ 116 


108 


118 


11 4 


119 


160 


126 


125^ 


12 


164 


206 


174 


221 


13 


164 ♦ 


434 


217 


193 


. W 


294 


233 


2o5 




' 15 


153 


123 


129 


486 


16* 


165 * 


228 


307 


' 241 


17 


129 


100 


85 


267 


18 


166 


274 


210 


185 


19 


/ 100 


138 


135 


110 


Mean 


162,7 


213.9 


'170.7 


217.0 
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Table ^2 

* ■ . . .- 

Positive and Negative Changes xn Nurriber of Words 
and Percentages, Narratives Written by • 
Secondary School Students , During and 
After Instruction 



Student 


{Trial 2 


Trial 3 


Trial 4 


f 


Iif Words 


In % 


In Words 


In % 


In Words 


In % 


1 




.94 




»13 


65 


.33 


2 


^-129 


-♦36 


-128 


-•35 


-207 


-.57 


3 


12U 


1,16 


59 


#55, 


22 


.21 


If 


105 




110 


♦ 47 


il9 


.51 


5 


109 


.97 


-9 


-.08 


94 


.84 


6 


187 


2.05 


4 


.04 


-?6 ■ 


-.29 


7 ' 




-.04 


-80 


-.60 


■ 100 


.75 


8 


-83 


-.58 


-73 


-.09. 


-14 


-.10 


9 




29 


79 


-.03 


5 


.03 


10 


6 • 


.05 


-2 


-.07 


8 


.0/ 


11 


HI 


.34 




.06 


6 


.05 


12 


42 


.25 


10 


.06 


57 


.35 


13 


270 


1.65 


'' 53 


.35 


29 


.18 


• 14 


61 


.21 


, 59 


.20 


197 


.67 


15 


30 


.13 


24* 


' .15 


338 


2.21 


16 


65 


.39* 


142 


.86 


76 


.46 


17 


-29 


-.22 


44 


1.07 


138 


1,07 


18 


108 


.65 


44 


.27 


19 


.11 


19 


38 


.38 


35 


.35 


10 ^ 


.10 


Mean 


60.8 


.45 


21.3 


.18 


54.5 


.37 
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